Real-time Face Swapping in Video Sequences: Magic Mirror

Magic Mirror is a face swapping tool that replaces the user’s face with a selected famous person’s face in a database. The system consists of a user interface from which the user can select one of the celebrities listed. Upon selection, model fitting automatically starts using the results of face detection and facial feature localization. Model fitting results in a set of points which describe the estimated shape of user’s face. By using the shape information, user’s face is replaced with the selected celebrity’s face. After some post processing for color and lighting adjustments are applied, final output is displayed to the user. The proposed system is able to run in real-time and generates satisfactory face swapping which can be applied for face de-identification in videos or other entertainment applications.